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(54) Picture information conversion and video processor 



(57) A picture information converting apparatus 
generates an output picture signal with a different scan- 
ning line structure from an input picture signal. The ap- 
paratus comprises a first picture signal is disclosed, that 
comprises a first picture data selecting means for se- 
lecting adjacent pixels with a predetermined relation of 
positions to a plurality of considered points with a differ- 
ent relation of positions to scanning lines ol the input 
picture signal, a spatial class detecting means for de- 
tecting a pattern of a level distribution from picture data 
selected by said first picture data selecting means and 
determining spacial class values that represent spatial 
classes of the ccnsideied points corresponding to the 
detected pattern, a second picture data selecting means 
for selecting the considered points and adjacent pixels 
with the predetermined relation of positions to the con- 
sidered points from the input picture signal, a calculating 
process means for performing a calculating process-for 
predicting and generating pixels at positions with a pre- 
determined relation of positions to the considered points 
corresponoing to the picture data obtained by said sec- 
ond picture data selecting means, a storing means for 
storing predetermined predictive coefficient data used 
in the calculating process of said calculating process 
means, and a class value converting means for perform- 



ing a class value converting process for a first class val- 
ue with a relation of positions to the considered points 
and the input picture signal and generating a second 
class value corresponding to the predictive coefficient 
data. 

Fig. 2 
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Description 

[0001] The present invention relates to a picture information conversion and video processor. 

[0002] Illustrative embodiments of the invention relate to a picture information converting apparatus, a picture infor- 
mation converting method, and a video processor such as a television receiver. 

[0003] To obtain an output picture signal with higher resolution than an input picture signal, a picture information 
converting process for generating an output scanning line structure with a scanning line structure different from an 
input picture signal has been proposed. In the picture information converting process, classes are categorized corre- 
sponding to a three-dimensional (time-space) distribution of signal levels of the input picture signal. With reference to 
the obtained class values, pixels are predicted and generated. In such a process, it is more difficult to predict and 
generate pixels at positions of scanning lines of the input picture signal than pixels at other positions thereof. 
[0004] Thus, when more classes are assigned to non-scanning-line positions of the input picture signal and pixels 
are more accurately predicted and generated, a memory that stores data predicted and generated in the class cate- 
gorizing process can be more effectively used. 

[0005] However, as the number of classes becomes large, the storage capacity of the memory becomes large. Since 
the storage capacity of the memory of a real apparatus is restricted, it is necessary to decrease the number of classes. 
[0006] Embodiments of the present invention seek to provide a picture information convening apparatus, a picture 
information converting method, and a video processor, for example, a television receiver that allow a proper number 
of classes to be assigned corresponding to the relation of positions of pixels predicted and generated and postions of 
scanning lines of an input picture signal, conditions such as the storage capacity of a memory disposed in the apparatus, 
and so forth 

[0007] A first aspect of the present invention is a picture information converting apparatus for generating an output 
picture signal with a different scanning line structure from an input picture signal, comprising a first picture data selecting 
means for selecting adjacent pixels with a predetermined relation of positions to a plurality of considered points with 
a different relation of positions to scanning lines of the input picture signal a spatial class detecting means for detecting 
a pattern of a level distribution from picture data selected by said first picture data selecting means and determining 
spacial class values that represent spatial classes of the considered points corresponding to the detected pattern, a 
second picture data selecting means for selecting the considered points and adjacent pixels with the predetermined 
relation of positions to the considered points from the input picture signal, a calculating process means for performing 
a calculating process for predicting and generating pixels at positions with a predetermined relation of positions to the 
considered points corresponding to the picture data obtained by said second picture data selecting means, a storing 
means for storing predetermined predictive coefficient data used in the calculating process of said calculating process 
means, and a class value converting means for performing a class value converting process for a first class value with 
a relation of positions to the considered points and the input picture signal and generating a second class value cor- 
responding to the predictive coefficient data. 

[0008] A second aspect of the present invention is a picture information converting apparatus for generating an 
output picture signal with a different scanning line structure from an input picture signal, comprising a first picture data 
selecting means for selecting adjacent pixels with a predetermined relation of positions to a plurality of considered 
points with a different relation of positions to scanning lines of the input picture signal, a spatial class detecting means 
for detecting a pattern of a level distribution from picture data selected by said first picture data selecting means and 
determining spacial class values that represent spatial classes of the considered points corresponding to the detected 
pattern, a second picture data selecting means for selecting adjacent pixels with the predetermined relation of positions 
to the considered points from a plurality of frames of the input picture signal, a motion class detecting means for 
calculating the sum of the absolute values of frame differences with the picture data selected by said second picture 
data selecting means and determining motion class values corresponding to the calculated result, the motion class 
values representing motions, a class combining means for combining the spatial class values and the motion class 
values so as to generate a first class value, a third picture data selecting means for selecting the considered points 
and adjacent pixels with the predetermined relation of positions to the considered points from the input picture signal, 
a calculating process means for perfor ming a calculating process for predicting and generating pixels at positions with 
a predetermined relation of positions to the considered points corresponding to the picture data obtained by said third 
picture data selecting means, a storing means for storing predetermined predictive coefficient data used in the calcu- 
lating process of said calculating process means, and a class value converting means for performing a class value 
converting process for the first class value with a relation of positions to the considered points and the input picture 
signal and generating a second class value corresponding to the predictive coefficient data. 

[0009] A third aspect of the present invention is a picture information converting method for generating an output 
picture signal with a different scanning line structure from an input picture signal, comprising the steps of (a) selecting 
adjaceni pixels with a predetermined relahon of positions to a plurality of considered points with a different relation of 
positions to scanning lines of the input picture signal, (b) detecting a pattern of a level distribution from picture data 
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selected at step (a) and determining spacial class values that represent spatial classes of the considered points cor- 
responding to the detected pattern (c) selecting the considered points and adjacent pixels with the predetermined 
relation of positions to the considered points from the input picture signal, (d) performing a calculating process for 
predicting and generating pixels at positions with a predetermined relation of positions to the considered points corre- 
5 sponding to the picture data obtained at step (c) : (e) storing predetermined predictive coefficient data used in the 
calculating process of step (d), and (f ) performing a class value converting process for a first class value with a relation 
of positions to the considered points and the input picture signal and generating a second class value corresponding 
to the predictive coefficient data. 

[0010] A forth aspect of the present invention is a picture information converting method for generating an output 

10 picture signal with a different scanning line structure from an input picture signal, comprising the steps of (a) selecting 
adjacent pixels with a predetermined relation of positions to a plurality of considered points with a different relation of 
positions to scanning lines of the input picture signal, (b) detecting a pattern of a level distribution from picture data 
selected at step (a) and determining spacial class values that represent spatial classes of the considered points cor- 
responding to the detected pattern, (c) selecting adjacent pixels with the predetermined relation of positions to the 

75 considered points from a plurality of frames of the input picture signal, (d) calculating the sum of the absolute values 
of frame differences with the picture data selected at step (c) and determining motion class values corresponding to 
the calculated result, the motion class values representing motions, (e) combining the spatial class values and the 
motion class values so as to generate a first class value, (f) selecting the considered points and adjacent pixels with 
the predetermined relation of positions to the considered points from the input picture signal, (g) performing a calculating 

20 process for predicting and generating pixels at positions with a predetermined relation of positions to the considered 
points corresponding to the picture data obtained at step (f), (h) storing predetermined predictive coefficient data used 
in the calculating process of step (g), and (i) performing a class value converting process for the first class value with 
a relation of positions to the considered points and the input picture signal and generating a second class value cor- 
responding to the predictive coefficient data. 

25 [0011] A fifth aspect of the present invention is a video signal processor for example a television receiver for gen- 
erating an output picture signal with a different scanning line structure from an input picture signal, comprising a first 
picture data selecting means for selecting adjacent pixels with a predetermined relation of positions to a plurality of 
considered points with a different relation of positions to scanning lines of the input picture signal, a spatial class 
detecting means for detecting a pattern of a level distribution from picture data selected by said first picture data 

30 selecting means and determining spacial class values that represent spatial classes of the considered points corre- 
sponding to the detected pattern, a second picture data selecting means for selecting the considered points and ad- 
jacent pixels with the predetermined relation of positions to the considered points from the input picture signal, a cal- 
culating process means for performing a calculating process for predicting and generating pixels at positions with a 
predetermined relation of positions to the considered points corresponding to the picture data obtained by said second 

35 picture data selecting means, a storing means for storing predetermined predictive coefficient data used in the calcu- 
lating process of said calculating process means, and a class value converting means for performing a class value 
converting process for a first class value with a relation of positions to the considered points and the input picture signal 
and generating a second class value corresponding to the predictive coefficient data. 

[0012] A sixth aspect of the present invention is a video signal processor for example a television receiver, for 

•*o generating an output picture signal with a different scanning line structure from an input picture signal, comprising a 
first picture data selecting means for selecting adjacent pixels with a predetermined relation of positions to a plurality 
of considered points with a different relation of positions to scanning lines of the input picture signal, a spatial class 
detecting means for detecting a pattern of a level distribution from picture data selected by said first picture data 
selecting means and determining spacial class values that represent spatial classes of the considered points corre- 

•*s sponding to the detected pattern, a second picture data selecting means for selecting adjacent pixels with the prede- 
termined relation of positions to the considered points from a plurality of frames of the input picture signal, a motion 
class detecting means for calculating the sum of the absolute values of frame differences with the picture data selected 
by said second picluie data selecting means and determining motion class values corresponding to the calculated 
lesult. the motion class values representing motions, a class combining means for combining the spatial class values 

so and the motion class values so as to generate a first class value, a third picture data selecting means for selecting the 
considered points and adjacent pixels with the predetermined relation of positions to the considered points from the 
inout picture signal, a calculating process means for performing a calculating process for predicting and generating 
pixels at positions with a predetermined relation of positions to the considered points corresponding to the picture data 
obtained by said third picture data selecting means, a storing means for storing predetermined predictive coefficient 

55 data used in the calculating process ol said calculating process means, and a class value converting means for per- 
forming a class value converting process for the first class value with a relation of positions to the considered points 
and the input picture signal and generating a second class value corresponding to the predictive coefficient data. 
[0013] According io the present invention, the number of classes for each of considered points (pixels) is properly 
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assigned corresponding to a relation that represents whether or not each considered point is present at a position on 
a scanning line of an input picture signal or corresponding to a condition such as the storage capacity of a memory of 
the apparatus. 

[0014] The following patents/applications have been filed by the applicant of the present invention: 

1) Japanese Patent Application No H09-1 15437 

2) Japanese Application No H10-228221, and 

3) US Patent No 5,049 ; 990 

[0015] A better understanding of the present invention will become more apparent in light of the following illustrative 
description of embodiments thereof, as illustrated in the accompanying drawings, in which: 

Fig. 1 is a schematic diagram showing an example of the arrangement of pixels in a picture information converting 
process according to an embodiment of the present invention: 

Fig. 2 is a block diagram showing an example of the structure of the picture information converting process system 
according to the first embodiment of the present invention; 

Fig. 3 is a schematic diagram showing an example of the arrangement of spatial class taps of line data y 1 according 
to the first embodiment of the present invention; 

Fig. 4 is a schematic diagram showing an example of the arrangement of spatial class taps of line data y2 according 
to the first embodiment of the present invention: 

Fig. 5 is a schematic diagram showing an example of the arrangement of motion class taps according to the first 
embodiment of the present invention; 

Fig. 6 is a schematic diagram for explaining a class integration according to the first embodiment of the present 
invention; 

Fig. 7 is a block diagram showing an example of the structure of a class value conversion tabic generating process 
system according to the first embodiment of the present invention: 

Fig. 8 is a schematic diagram for explaining a thin-out filter process used in the class value conversion table 
generating process system and a predictive coefficient calculating process system: 

Fig 9 is a block diagram showing an example of the structure of the predictive coefficient calculating process 

system according to the first embodiment of the present invention; 

Fig. 10 is a schematic diagram for explaining a line double speed process; 

Fig. 11 is a schematic diagram showing an example of the arrangement of spatial class taps according to a second 
embodiment of the present invention: 

Fig. 1 2 is a schematic diagram for explaining a class integration according to the second embodiment of the present 
invention: 

Fig. 1 3 is a block diagram showing an example of the structure of a picture information converting process system 
according to the second embodiment of the present invention; 

Fig. 1 4 is a schematic diagram showing an example of the arrangement of pixels in a picture information converting 
process according to the second embodiment of the present invention: 

Fig. 15 is a schematic diagram showing an example of the arrangement of spatial class taps according to the 
second embodiment of the present invention; and 

Fig. 16 is a schematic diagram showing an example of the arrangement of motion class taps according to the 
second embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0016] Before explaining embodiments of the present invention, an illustrative picture information converting process 
according to the present invention will be described. In the picture information converting process, a digital picture 
signal with standard resolution (her einafter this signal is referred to as SD signal) is converted into a picture signal with 
high resolution (sometimes this signal is referred to as HD signal) and the resultant signal is output. An example of the 
SD signal is an interlace picture signal with 525 scanning lines (hereinafter this signal is referred to as 525i signal). A 
example of the HD signal is a progressive signal with 525 scanning lines (hereinafter this signal is referred to as 525p 
signal). The number of pixels in the horizontal direction of the output picture signal is twice as many as that of the input 
picture signal. 

[0017] In the picture information converting process, the resolution of the input picture signal is improved by a class 
categorization adaptive process. The class categorization adaptive process is different from a conventional method of 
which a signal wiih high resolution is obtained by an interpolating process In other words, in the class categorization 
adaptive process, classes are categorized corresponding to a three-dimensional (time-space) distribution of signal 
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levels of the input SD signal. Predicted values for individual classes are leant and stored to a particular storing portion. 
An optimum estimated value is calculated and obtained corresponding to a predictive expression In the class catego- 
rization adaptive process, an output signal with higher resolution than an input SD signal can be obtained. 
[001 8] Fig. 1 shows an example of the arrangement of pixels of one field (odd field) in a picture information converting 
process for converting a 525i signal as an input SD signal into a 525p signal as an output picture signal. In Fig. 1 , large 
dots represent pixels of the 525i signal, whereas small dots represent pixels of 525p signal. The scanning lines of the 
525i signal of the odd field spatially deviates by 0.5 lines from that of the even field. As is clear from Fig. 1, with line 
data y1 (black small dots) at the same position of a line of the 525i signal and line data y2 (white small dots) at the 
center position between two adjacent lines of the 525i signal, the 525p signal is predicted and generated. 
[0019] In Fig. 1 , y1 represents points that exist, whereas y2 represents points that are newly predicted and generated. 
Thus, it is more difficult to predict and generate y2 than yl . Consequently, to predict and generate y2, more classes 
should be assigned than y i . When the memory in the apparatus does not have sufficient storage capacity or the picture 
information converting process is performed with a small number of classes, the total number of classes should be 
decreased. Thus, in an example of the present invention, the number of classes are properly assigned so that y1 and 
y2 can be effectively and precisely predicted and generated. 

[0020] Next, with reference to the accompanying drawings, a first embodiment of the present invention will be de- 
scribed. In the first embodiment, a picture information converting process is performed. In the picture information con- 
verting process, a 525i signal as an input SD signal is converted into a 525p signal as an output picture signal. However, 
it should be noted that the present invention can be applied to signal conversions in other picture signal formats. Fig. 
2 is a block diagram showing an example of the structure of a picture information converting process system according 
to the first embodiment of the present invention. The input SD signal (525i signal) is supplied to tap selecting circuits 
1, 10, 11, and 20. 

[0021] The tap selecting circuit 1 extracts a region of a plurality of pixels necessary for a calculating process (corre- 
sponding to formula (1) (that will be described later) for predicting and estimating line data y1 and y2 and selects SD 
pixels (hereinafter referred to as predictive taps) necessary for predicting and estimating the line data y1 and y2 from 
the extracted region. The selected predictive taps are supplied to estimation predictive calculating circuits 4 and 5. The 
predictive taps may be the same as spatial class taps (that will be described later). To improve the predictive accuracy, 
the predictive taps are selected with predictive tap position information corresponding to classes. 
[0022] A coefficient memory 41 (that will be described later) supplies predictive coefficients necessary for predicting 
and estimating the line data y1 and y2 to the estimation predictive calculating circuits 4 and 5, respectively. The esti- 
mation predictive calculating circuits 4 and 5 successively predict and generate pixel values y with the predictive taps 
received from the tap selecting circuit 1 and the predictive coefficients received from the coefficient memory 41 corre- 
sponding to the following formula (1). 

y = w1 x xl + w2 x x2 + ... + wn x xn (1) 

where x1 , ... , and xn represent predictive taps: and w1 s and wn are predictive coefficients. In other words, formula 
(1) is an expression for predicting and generating a pixel value y with n predictive taps. The estimation predictive 
calculating circuit 4 predicts and generates line data yl as a sequence of pixel values y. Likewise, the estimation 
predictive calculating circuit 5 predicts and generates line data y2. The predictive coefficients w1, ... , and wn of the 
line data y 1 are different from those of the line data y2. 

[0023] The estimation predictive calculating circuits 4 and 5 supply the line data y1 and y2 to a line sequence con- 
verting circuit 6. respectively. The line sequence converting circuit 6 performs a line double speed process for the 
received line data y1 and y2 and generates a signal with high resolution (referred to as high resolution signal). The 
high resolution signal is a final output picture signal of the picture information converting process system according to 
the first embodiment of the present invention. The output picture signal is supplied to a CRT display (not shown). The 
CRT display has a synchronous system that allows the output picture signal (525p signal) lo be displayed. Examples 
of the input SD signal are a broadcast signal and a reproduction signal of a reproducing apparatus such as a VCR. In 
other words, the picture information converting process system according to the first embodiment of the present in- 
vention can be built in a TV receiver or the like. 

[0024] Each of the tap selecting circuits 10 and 11 selects SD pixels necessary for detecting spatial classes of the 
line data yl and y2 (these pixels arc referred to as spatial class taps). The tap selecting circuit 20 selects SD pixels 
necessary ior detecting a motion class of the input SD signal (these pixels are referred to as motion class taps). Output 
data of the tap selecting circuit 10 is supplied to a spatial class detecting circuit 12. Output data of the tap selecting 
circuit 1 1 is supplied to a spatial class detecting circuit 1 3. Output data of the tap selecting circuit 20 is supplied to a 
motion class detecting circuit 21 

[0025] The spatial class detecting circuits 12 and 13 detect spatial class values of the line data y1 and y2 corre- 
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sponding to the received spatial class taps and supply the detected spatial class values to class combining circuits 30 
and 31 , respectively. The motion class detecting circuit 21 detects a motion class value corresponding to the received 
motion class taps and supplies the detected motion class value to the class combining circuits 30 and 31. 
[0026] Each of the class combining circuits 30 and 31 combines the received spatial class value and the received 
motion class value. Output data of the class combining circuit 30 is supplied to a class value converting circuit 32. 
Output data of the class combining circuit 31 is supplied to a class value converting circuit 33. The class value converting 
circuits 32 and 33 perform a class value converting process (that will be described later) for output data of the class 
value combining circuits 32 and 33. respectively. The class value converting process allows the total number of classes 
to be decreased. 

[0027] The converted class values are supplied to a coefficient memory 41 . The coefficient memory 41 stores pre- 
dictive coefficients that have been learnt and supplies predictive coefficients corresponding to the class values received 
from the class value converting circuits 32 and 33 to the estimation predictive calculating circuits 4 and 5. To do that, 
for example, a method for storing predictive coefficients corresponding to addresses designated with class values 
obtained in the class value converting process may be used. 

[0028] Next, a process for detecting a spatial class will be described in detail. Generally, each spatial class detecting 
circuit detects a spatial pattern of a level distribution of picture data corresponding to a pattern of a level distribution 
of spatial class taps and generates a spatial class value corresponding to the detected spatial pattern. In this case, to 
prevent the number of classes from becoming huge : each input pixel is compressed to data with less than eight bits. 
As examples of such an information compressing process, ADRC (Adaptive Dynamic Range Coding), DPCM (Differ- 
ential Pulse Code Modulation), and VQ (Vector Quantization) may be used. 

[0029] The ADRC method is an adaptively re-quantizing method developed for a high efficient encoding process for 
use with a VCR (Video Cassette Recorder). Since the ADRC method allows a local pattern of a signal level to be 
effectively represented with a short word length, according to the first embodiment of the present invention, the ADRC 
method is used to generate a spatial class categorized code. In the ADRC method, the length between the maximum 
value MAX and the minimum value MIN is equally divided by a designated bit length and rc-quantized corresponding 
to the following formula (1 ). 



DR = MAX - MIN + 1 

30 

Q = {(L - MIN + 0.5) x 2 / DR} (2) 

where DR represents the dynamic range of spatial class taps: L represents the data level of the pixel of each spacial 

35 class tap: Q represents a re-quantized code: and { } represents a truncating process. 

[0030] As described above, the number of classes of the line data y2 is larger than that of the line data y1 . Next, 
this point will be described in detail. Fig. 3 shows an example of the arrangement of spatial class taps used in the 
spatial class detecting process for the line data y1 . In Fig. 3, when time elapses in the horizontal direction (from left to 
right), pixels in individual fields are arranged in the vertical direction. 

jo [0031] Fields shown in Fig. 3 are denoted by F-1/o (at the leftmost position), F-1/e, F/o, and F/e (at the rightmost 
position). The field F-1 /o represents "a field composed of odd-numbered scanning lines of the (F-1 )th frame". Likewise, 
the field F-t/e represents "a field composed of even-numbered scanning lines of the (F-1)th frame". The field F/o 
represents "a field composed of odd-numbered scanning lines of the F-th frame". Likewise, the field F/e represents "a 
field composed of even-numbered scanning lines of the F-th frame". 

45 [0032] For example, as spatial class taps of the line data yl of the field F/o. a total of five pixels - pixels T4 and T5 
of the field F-Ve and pixels T1 T2, and T3 of the field F/o are used. However according to the present invention, other 
spatial class laps may be used. For example, as spatial class laps, a plurality of inpul pixels in the horizontal direction 
may be used. 

[0033] Fig. 4 shows an example of the arrangement of spatial class taps used in the spatial class detecting process 
so for the line data y2. The notation of Fig. 4 is the same as the notation of Fig. 3. In this example, as spatial class taps 
of the line data y2 of the field F/o. a total of six pixels - a pixel T6 of the field F-Ve. pixels T2, T3. T4, and T5 of the 
field r/o. and a pixel Tl of the field F/c arc used. However, according to the present invention, other spatial class taps 
may be used. For example, as spatial class taps, a plurality of input pixels in the horizontal direction may be used. 
[0034] Next, the motion class detecting process will be described in detail. The motion class detecting circuit 21 
ss calculates the average value param of the absolute values of frame differences with the received motion class taps 
corresponoinc to the following formula (3). The motion class detecting circuit 21 detects a motion class value corre- 
sponding to the calculated param value 
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param - — ( 3 } 

[0035] In formula (3). n represents the number of motion class taps. For example. 6 is assigned to n (see Fig. 5). By 
comparing the param value with a preassigned threshold value, a motion class value as an index of a motion is deter- 
mined. For example the motion class value is generated as follows. 

param 2: motion class value = 0 
2 < param 4: motion class value = 1 
^ < param 8: motion class value = 2 
param > &: motion class value = 3 

[0036] When the motion class value is 0. the motion is minimum (still picture). As the motion class value becomes 
large, the motion of the picture becomes large. Alternatively, the motion class may be determined corresponding to a 
motion vector. 

[0037] Fig. 5 shows an example of the arrangement of motion class taps used in the motion class detecting process. 
For example, as motion class taps used for predicting the line data y1 and y2 of the field F/o : pixels n1 , n3, and n5 of 
the field F/o. pixels n2 : n4. and n6 of the field F/e, pixels m2. m4, and m6 of the field F-/e, and pixels ml, m3 : and m5 
of the field F-1/e are used. In this example, the vertical positions of the pixels ml, m2 and m6 match those of the 

pixels n1. n2 and n6, respectively. However, according to the present invention, other motion class taps may be 

used. 

[0038] In the arrangements of spatial class taps shown in Figs. 3 and 4, when the number of motion classes of each 
of the line data y1 and y2 is 4. the classes of each of the line data y1 and y2 can be categorized in one-bit ADRC 
method as follows. 

Number of classes of line data y1 = 25 x 4 = 1 28 



Number of classes of line data y2 = 26 x 4 = 256 

In this case, the total number of classes is 384. However, when the memory resource (the coefficient memory 41 shown 
in Fig. 2) of the picture information converting process system does not have sufficient storage capacity for 384 classes 
or when the picture information converting process is effectively performed with a smaller number of classes it is 
necessary to decrease the total number of classes. Thus, according to an example of the present invention, with a 
class value converting process, the numbers of classes of the line data y1 and y2 are decreased. Fig. 6 shows a 
process for decreasing the total number of classes. Temporary predictive coefficients shown in Fig. 6 will be described 
later. 

[0039] Next, a learning process (namely, a process for setting proper predictive coefficients) will be described. Fig. 
7 shows an example of the structure of a process system that generates a class value conversion table as a first 
learning stage. A known signal (for example, a 525p signal) in the same signal format as an output picture signal is 
supplied to a thin-out filter 51 and normal equation adding circuits 61 and 62. The thin-out filter 51 thins out the number 
of pixels by 1/2 in each of the horizontal and vertical directions. Thus the thin-out filter 51 generates an SD signal (for 
example, a 525i signal) with pixels that are 1/4 as small as Ihose of the input signal. 

[0040] In the thin-out process, a vertical thin-out filter thins out pixels of the input picture signal so that the frequency 
in the vertical direction of the input picture signal is halved. In addition, a horizontal thin-out filter thins out pixels of the 
input picture signal so that the frequency in the horizontal direction of the input picture signal is halved. By varying the 
characteristics of the thin-out filter 51 . the learning characteristics are varied. Thus, the picture quality of the picture to 
be converted can be controlled. 

[0041 ] Fig. 8 shows the spatial relation between pixels of a 525p signal as an example of the SD signal that is supplied 
to the thin-out filter 51 and pixels of a 525i signal as an example of the output picture signal of the thin-out filter 51. In 
the odd-numbered field of the 525p signal, even numbered lines are ihinned out. On each odd-numbered line, pixels 
are alternately thinned out in the horizontal direction. In Fig. 8. the first field and the third field that have been thinned 
out are shewn On the other hand, in the odd-numbered field of the 525p signal, odd-numbered lines are thinned out. 
On each even-numbered line, pixels are alternately thinned out in the horizontal direction Fig. 8 also shows the second 
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field of which pixels have been thinned out. 

[0042] In Fig 7. the thin-out filter 51 generates a interlace picture signal and supplies it to tap selecting circuits 101 , 
110. 111. and 120. The tap selecting circuit 101 selects predictive taps used in a calculation of a normal equation (that 
will be described later). The tap selecting circuit 101 supplies the selected predictive taps to normal equation adding 
circuits 61 and 62. On the other hand, the tap selecting circuits 110 and 111 select spatial class taps of the line data 
y1 and y2 and supply the selected spatial taps to spatial class detecting circuits 112 and 113, respectively. The tap 
selecting circuit 120 selects motion class taps and supplies the selected motion class taps to a motion class detecting 
circuit 121 . 

[0043] The spatial class detecting circuits 112 and 113 compress data of the spatial class taps corresponding to the 
ADRC method and detect spatial class values of the line data yi and y2 ; respectively. The motion class detecting 
circuit 121 detects motion class values. Output data of the spatial class detecting circuit 112 and the motion class 
detecting circuit 121 is supplied to a class combining circuit 1 30. In addition, output data of the spatial class detecting 
circuit 1 1 3 and the motion class detecting circuit 1 21 are supplied to a class combining circuit 1 31 . The class combining 
circuit 1 30 combines the spatial class value and the motion class value of the line data y1 . The class combining circuit 
1 31 combines the spatial class value and the motion class value of the line data y2. Output data of the class combining 
circuit 130 and the class combining circuit 131 are supplied to the normal equation adding circuits 61 and 62. respec- 
tively. 

[0044] The normal equation adding circuit 61 performs an adding operation tor obtaining data of a normal equation 
having a solution of predictive coefficients for predicting and generating the line data yi corresponding to the input SD 
signal. Ihe output data of the tap selecting circuit 1 01 , and the output data of the class combining circuit 1 30. Likewise, 
the normal equation adding circuit 62 performs an adding operation for obtaining data of a normal equation having a 
solution of predictive coefficients for predicting and generating the line data y2 corresponding to the input SD signal, 
the output signal of the tap selecting circuit 101, and the output data of the class combining circuit 131. 
[0045] The normal equation adding circuits 61 and 62 supply their calculated data to a temporary predictive coefficient 
determining circuit 63. The temporary predictive coefficient determining circuit 63 performs a calculating process for 
solving the normal equation corresponding to the received data, calculates temporary predictive coefficients for pre- 
dicting and generating the line data y 1 and y2 and supplies the calculated temporary predictive coefficients to a adjacent 
coefficient class integrating process portion 64. The temporary predictive coefficients are not final predictive coefficients 
because they are determined as the result of the class integrating process (that will be described later). The calculating 
process for solving the normal equation is the same as that of a predictive coefficient determining circuit 263 {that will 
be described later with reference to Fig. 9). 

[0046] The adjacent coefficient class integrating process portion 64 calculates the distance d between the temporary 
predictive coefficients corresponding to the following formula (4). 



where kl and kl' represent predictive coefficients of different classes: I represents a predictive tap number: and n rep- 
resents the total number of predictive taps. 

[0047] The adjacent coefficient class integrating process portion 64 compares the distances of predictive coefficients 
of different classes with a predetermined threshold value and integrates a plurality of classes whose distance is smaller 
than the threshold value into one class. By integrating a plurality of classes, the total number of classes can be de- 
creased. When distances of par ticular classes are smaller than the threshold value, classes whose distance is minimum 
are integrated. As the threshold value becomes large, the number of classes that can be deleted becomes large. Thus, 
by varying the threshold value, the number of classes obtained in the class value converting process can be adjusted. 
[0048] At this point, by properly assigning classes to the line data yi and y2 corresponding to particular conditions 
such as the storage capacity of the memory resource (the coefficient memory 41 shown in Fig. 2) of the picture infor- 
mation converting process system, the memory resource can be effectively used. In addition, with a smaller number 
of classes, the picture information converting process can be effectively performed. 

[0049] The adjacent coefficient class integrating process portion 64 supplies information for integrating classes to a 
class value converting table generating portion 35. The class value converting table 65 generates a class value con- 
version table corresponding to the received information The class value conversion table is supplied to the class value 
converting circuits 32 and 33 (see Fig 2) and class value converting circuits B1 and 82 (that will be described later 
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with reference to Fig. 9). The class value converting circuits 32 and 33 and the class value converting circuits 81 and 
82 store and reference the class value conversion table. 

[0050] Next, a predictive coefficient calculating process as a second learning stage will be described. Fig. 9 shows 
an example of the structure of a predictive coefficient calculating process system that calculates predictive coefficients. 
s A known signal (for example, a 525p signal) in the same signal format as an output picture signal is supplied to a thin- 
out filter 251 and normal equation adding circuits 261 and 262. The thin-out filter 251 thins out the number of pixels 
by 1/2 in each of the horizontal and vertical directions. Thus, the thin-out filter 251 generates an SD signal (for example, 
a 525i signal) with pixels that are 1/4 as small as those of the input signal. 

[0051] In the thin-out process, a vertical thin-out filter thins out pixels of the input picture signal so that the frequency 
io in the vertical direction of the input picture signal is halved. In addition, a horizontal thin-out filter thins out pixels of the 
input picture signal so that the frequency in the horizontal direction of the input picture signal is halved. The thin-out 
filter 251 supplies the SD signal to tap selecting circuits 201, 210. 211, and 220. By varying the characteristics of the 
thin-out filter 251 . the learning characteristics are varied. Thus the picture quality of the picture to be converted can 
be controlled. 

15 [0052] The tap selecting circuit 201 selects predictive taps and supplies the selected predictive taps to normal equa- 
tion adding circuits 261 and 262. The tap selecting circuits 210 and 211 select spatial class taps tor the line data y1 
and y2 and supplies the selected spatial class taps to spatial class detecting circuits 212 and 213, respectively A tap 
selecting circuit 220 selects predictive taps and supplies the selected predictive taps to a motion class detecting circuit 
221. 

20 [0053] The spatial class detecting circuits 212 and 213 delect spatial class values for the line data y1 and y2 corre- 
sponding to the received spatial class taps, respectively. The motion class detecting circuit 221 detects a motion class 
value corresponding to the received motion class taps. Output data of the spatial class detecting circuit 212 and the 
motion class detecting circuit 212 is supplied to a class combining circuit 230. In addition, output data of the spatial 
class detecting circuit 212 and the motion class detecting circuit 221 is supplied to a class combining circuit 231. The 

25 class combining circuits 230 and 231 combine class values for the line data y1 and y2 and supply the combined class 
values to class value converting process portions 81 and 82, respectively. 

[0054] The class value converting process portions 81 and 82 store the above-mentioned class value conversion 
table. With reference to the class value conversion table, the class value converting process portions 81 and 82 convert 
the class values received from the class combining circuits 230 and 231, respectively. The class value converting 
30 process portions 81 and 82 supply the resultant class values to the normal equation adding circuits 261 and 262, 
respectively. 

[0055] The normal equation adding circuits 261 and 262 calculate data used in a calculating process for solving a 
normal equation having a solution of predictive coefficients. In other words, the normal equation adding circuit 261 
performs an adding process corresponding to the input SD signal, the output data of the tap selecting circuit 201 , and 

35 the output data of the class value converting circuit 81 and obtains data necessary for solving a normal equation having 
a solution of predictive coefficients for predicting and generating the line data y 1 . Likewise, the normal equation adding 
circuit 262 performs an adding process corresponding to the input SD signal, the output data of the tap selecting circuit 
201, and the output data of the class value converting circuit 82 and obtains data necessary for solving a normal 
equation having a solution of predictive coefficients for predicting and generating the line data y2. 

40 [0056] Data obtained by the normal equation adding circuits 261 and 262 is supplied to a predictive coefficient de- 
termining circuit 263. The predictive coefficient determining circuit 263 performs a calculating process for solving a 
normal equation corresponding to the received data and obtains predictive coefficients for predicting and generating 
the line data y1 and y2 The obtained predictive coefficients are supplied to a coefficient memory 84. The coefficient 
memory 84 stores the predictive coefficients. 

45 [0057] Next, the predictive coefficient determining process (performed by the normal equation adding circuits 261 
and 262 and the predictive coefficient determining circuit 263) will be described in detail. First of all, a normal equation 
will be described. As described above, with n predictive taps, pixels that compose the line data yl and y2 can be 
successively predicted and generated corresponding to formula (1). 

[0058] In formula (1), predictive coefficients w1, .. , and wn are initially indeterminate coefficients. A plurality of pieces 
so of signal data are learned for individual classes. When the total number of pieces of signal data is denoted by m, the 
following formula (5) is given corresponding to formula (1). 

yk - w1 x xkl + w2 x xk2 + . .. + wn x xkn (5) 

55 

where k = 1 2 m In the case of m > n. since the predictive coefficients w1 1 .... and wn are not uniquely defined. 

elements ek of an error vector e are defined by the following formula (6). Predictive coefficients that minimize the error 
vector e defined by formula (7) are obtained. In other words, predictive coefficients are uniquely obtained by so-called 
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method of least squares. 

ek = yk - {w1 x xk1 + w2 x xk2 + ... + wn x xkn} (6) 

where k = 1, 2. ... t m 



m 



To obtain predictive coefficients that minimize e2 of formula (7), e2 is partially differentiated with predictive coefficients 
wi (where i = 1. 2, ...» (formula (8)). Each predictive coefficient wi is defined so that the partial differential value of each 
value of i becomes 0. 



° w i fro dw, fro 



[0059] Next, a practical process (or defining each predictive coefficient wi corresponding to formula (8) will be de- 
scribed. When Xji and Yi are defined as formulas (9) and (10), lormula (8) can be written as a matrix of formula (11). 



p-0 



(9) 



... (10) 



X , y X JZ 

*21 ^22 



K Zn 



(11) 



X, X 

n I i 



nZ 



[0060] Formula (11) is referred to as normal equation The normal equation adding circuits 261 and 262 calculate 
data of the normal equation (namely Xji and Yi of formulas (9) and (10)) corresponding to Ihe class values received 
from the class value converting circuits 81 and 82. the predictive taps received from the predictive tap selecting circuit 
201 . and the known picture signal in the same signal format as the input picture signal and supply the obtained data 
of the normal equation to a predictive coefficient determining portion 263. The predictive coefficient determining portion 
263 performs a calculating process for solving the normal equation corresponding to a conventional matrix solving 
method such as swecp-out method with the data of the normal equation and obtains predictive coefficients wi. 
[0061] The predictive coefficients generated in such a manner are calculated corresponding to data of which class 
values have been converted. In contrast, temporary predictive coefficients described with reference to Fig. 7 are ob- 
tained corresponding todata of which class values have not been converted. Except for such a difference, the predictive 
coefficients and the iemporary predictive coefficients are obtained m the same calculating process as a solution of the 
normal equation Thus, the process for determining the temporary predictive coefficients is the same as the process 
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performed in the normal equation adding circuits 61 and 52 and the predictive coefficient determining circuit 63. 
[0062] In other words, in Fig. 7, the normal equation adding circuits 61 and 62 calculate data of the normal equation 
(namely, the values of Xji and Yi of formulas (9) and (10)) with the class values received from the class combining 
circuits 130 and 131. the predictive taps received from the predictive tap selecting circuit 101. and the known input 
picture signal (for example, a 525p signal) in the same signal format as the output picture signal and supply the cal- 
culated data of the normal equation to the temporary predictive coefficient determining portion 63. The temporary 
predictive coefficient determining portion 63 performs a calculating process for solving the normal equation correspond- 
ing to a conventional matrix solving method such as sweep-out method with the data of the normal equation. 
[0063] In such a manner, temporary predictive coefficients are obtained. With the calculated temporary predictive 
coefficients, a class value conversion table is generated. With reference to the class value conversion table, while 
class values are being converted, predictive coefficients are obtained. As a result, predictive coefficients for estimating 
a considered pixel of a progressive picture as a value that is statistically closest to a true value for each class are stored 
in the predictive coefficient memory 84. The predictive coefficients are loaded to the predictive coefficient memory 41 
of the picture information converting process system shown in Fig. 2. 

[0064] The picture signal converting process system shown in Fig. 5, the class value conversion table generating 
process system shown in Fig. 7, and the predictive coefficient process system shown in Fig. 9 may be separately 
disposed. Alternatively, with a switch or the like, these systems may be used in common. However, when such process 
systems are separately disposed, structural elements having the same function should have the same operating char- 
acteristics so as to secure the validity of the learning process. For example, the tap selecting circuits 1,51, and 201 
should have the same operating characteristics. When the structural elements are used in common, although the 
process of the apparatus becomes complicated due to the switching operations, the circuit scale of the apparatus is 
reduced. Thus, the cost of the apparatus can be reduced. 

[0065] The number of predictive taps that are output from the tap selecting circuit 201 is larger than the number of 
predictive taps used in the picture information conversing process system. Thus, in the predictive coefficient determin- 
ing portion 263 shown in Fig. 9, more coefficients for individual classes arc obtained. Predictive coefficients are selected 
in the order of the largest absolute value. 

[0066] Next, the line double speed process performed by the line sequence converting circuit 6 will be described. 
The horizontal period of the 525p signal generated by the estimation predictive calculating circuit 4 and 5 is the same 
as the horizontal period of the 525i signal of which the picture information converting process has not been performed. 
The line sequence converting circuit 6 has a line memory and performs a line double speed process for doubling the 
horizontal period therewith. Fig. 10 shows waveforms of analog signals of which the line double speed process is 
performed. The estimation predictive calculating circuits 4 and 5 predict and generate the line data y1 and y2. respec- 
tively 

[0067] The line data y1 contains lines al , a2, a3, and so forth in the order The line data y2 contains lines bl, b2, 
b3, and so forth in the order. The line sequence converting circuit 6 has a line doubler and a switching circuit (not 
shown). The line doubler compresses data of each line by 1/2 in the time axis direction and supplies the compressed 
data to the switching circuit. The switching circuit alternately selects received data and outputs the selected data. Thus, 
line sequence output data (aO, bO, a1 , b1 , and so forth) is formed. 

[0068] In the first embodiment, an output pixel value (line data LI ) of the current line and an output pixel value (line 
data L2) of a new line are generated at a time. Alternatively, with an additional memory, when the operation speed is 
sufficiently high, after line data y1 and y2 are successively generated on time division basis, the line double speed 
process may be performed for the line data y1 and y2. 

[0069] In the first embodiment according to the present invention, as shown in Figs. 3 and 4, the arrangement of 
spatial class taps of the line data yi is different from that of the line data y2 (the number of spatial class taps of the 
line data yi is 5. whereas the number of spatial class taps of the line data y2 is 6). Unlike with the first embodiment of 
the present invention, the number of spatial class taps of the line data yi may be the same as that of the line data y2. 
This arrangement will be described as a second embodiment of the present invention. Fig. 11 shows the arrangement 
of spatial class taps of the line data yi and y2 accoiding to the second embodiment of the present invention. The 
notation of Fig. 11 is the same as the notation of Fig. 3. As spatial class taps of the line data y1 and y2 of the field F/ 
o. a total of six pixels - pixels T5 and T6 of the field F-1/e. pixels T2. T3, and T4 of the field F/o. and a pixel T6 of the 
field F/e are used. When the motion class values oi the line data y1 are the same as those of the line data y2 and the 
number of motion class values is 4, the number of classes of each of the line data yi and y2 is 2 s x 4 = 256. 
[0070] Fig. 1 2 shows the state of which number of classes is decreased in the class value converting process. Before 
the class value converting process is performed, the number of classes of each of the line data y1 and y2 is 255. 
However, after the class value converting process is performed, the number of classes of the line data yi is smaller 
than that of the line data y2. This is because it is more difficult to predict and generate the line data y2 than the line 
data yi 

[0071] Next, with reference to Fig 1 3. the structure of a picture information converting process system according to 
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the second embodiment of the present invention will be described. For simplicity, in Fig. 1 3 : similar structural elements 
to those in Fig 4 are denoted by similar reference numerals. As described above : in the second embodiment, since 
the arrangement of spatial class taps of the line data y 1 is the same as that of the line data y2, the structure of a spatial 
class detecting portion for the line data yl is in common with that for the line data y2. To do that, a spatial class detecting 
circuit 16 and a tap selecting circuit 15 are disposed. The tap selecting circuit 15 selects a spatial class. The tap 
selecting circuit 15 is disposed upstream of the spatial class detecting circuit 16. 

[0072] A spatial class value that is output from the spatial class detecting circuit 16 and a motion class value that is 
output from a motion class detecting circuit 21 are supplied to a class combining circuit 1 7. The class combining circuit 
1 7 combines the spatial class value and the motion class value. Output data of the class combining circuit 1 7 is supplied 
to class value converting circuits 18 and 19. The class value converting circuits 13 and 19 perform a class value 
converting process for the output data of the class combining circuit 17 and generate converted class values of the 
line data y1 and y2, respectively. The class value converting process is performed so that classes are obtained corre- 
sponding to the difficulty for predicting and generating the line data y1 and y2. Output data of the class value converting 
circuits 1 8 and 1 9 is supplied to a coefficient memory 41 . 

[0073] In the second embodiment of the present invention, since the structure of the spatial class detecting portion 
lor the line data y1 is in common with that for the line data y2 : the structure of the apparatus can be simplified. On the 
other hand, in the class value converting process, the number of classes for the line data y 1 is more reduced than that 
for the line data y2. Thus, since the class value converting process for the line data yl may become complicated, the 
structure for detecting spatial classes for the line data y1 and the structure for detecting spatial classes for the line 
data y2 may be separately disposed as with the structure shown in Fig. 2. 

[0074] In the first and second embodiments of the present invention, a 525i signal is converted into a 525p signal. 
However, according to the present invention, the number of scanning lines is not limited to 525. For example, an output 
picture signal composing lines having pixels that are not twice those in the horizontal direction of an input SD signal 
may be predicted and generated. The present invention can be applied for a picture information converting process 
for orcdicting and generating an interlace picture signal (a 1050i signal) as an output picture signal. 
[0075] Next, such a picture information converting process will be described in detail. Fig. 1 4 shows the arrangement 
of pixels of a 521 signal and a I050i signal as a picture of one field. In Fig. 14, large dots represent pixels of the 525i 
signal, whereas small dots represent pixels of the 1050i signal. In Fig. 14, solid lines represent lines of an odd field of 
a particular frame, whereas doted lines represent another field (even field) of the frame. Each line of the even field 
deviates from each line of the odd field by 0.5 lines. On the lines of the even field, pixels of line data yV and y2* are 
formed. 

[0076] Fig. 15 shows the arrangement of spatial class taps in such a case. The notation of Fig. 15 is the same as 
the notation of Fig. 3. As spatial class taps for the line data yl and y2 of the field F/o, a total of seven pixels - pixels 
T4. T5, T6 : and T7 of the field F-1/e and pixels T1 . T2 : and T3 of the field F/o are used. When the motion class values 
of the line data y1 are the same as those of the line data y2 and the number of motion class values is 4, the number 
of classes of each of the line data y1 and y2 is 2 7 x 4 = 512. 

[0077] According to embodiments of the present invention, when a such a manner, a picture information converting 
process can be performed with the structure shown in Fig. 13. However, according to the present invention, spatial 
class taps may be arranged in a different manner. For example, the arrangement of spatial class taps for the line data 
y1 may be different from that for the line data y2. Alternatively, a plurality of input pixels in the horizontal direction may 
be used as spatial ciass taps. 

[0078] Fig. 16 shows an example of the arrangement of motion class taps in the case shown in Fig. 15. As motion 
class taps used for predicting line data y1 and y2 in the field F/o, pixels n1 , n3, and n5 of the field F/o, pixels n2, n4, 
and n6 of the field F/e. pixels m2. m4. and m6 of the field F-1/e, and pixels ml , m3. and m5 of the field F-1/o are used. 
In this example, the vertical positions of the pixels ml, m2, ... , and m6 match those of the pixels nl, n2. ... : and nS, 
respectively. However, according to the present invention, the arrangement of the motion class taps is not limited to 
that shown in Fig. 1 3. 

[0079] According to embodiments of the present invention, when a picture information converting process for con- 
verting an input pictuie signal into an output picture signal with a different scanning line structure is performed, the 
number of classes determined corresponding to each of a plurality of considered points at non-scanning-line positions 
of the input picture signal (the considered points are for example y1 at a position of a scanning line of the input picture 
signal. y2 at a position between adjacent two scanning lines, and so forth) is decreased corresponding to the relation 
of positions of the considered points to the scanning lines of the input picture signal (for example, many classes arc 
assigned to y2 that is difficult to predict and generate). 

[0080] Thus, since the number of classes is assigned corresponding to the storage capacity of the memory resource 
of the apparatus, even if the storage capacity of the memory resource is insufficient, the process can be properly 
performed In addition the present invention can be effectively applied for the case that the process is performed with 
a small number of classes 
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[0081] Moreover, classes can be properly assigned for each considered point corresponding to the difficulty (for 
example. y1 and y2) for predicting and generating pixels due to the difference between positions of a considered point 
and a scanning line of the input picture signal. Thus, even if the storage capacity of the memory resource is restricted, 
a picture information converting process can be precisely and effectively performed. 
5 [0082] Although the present invention has been shown and described with respect to illustrative embodiments there- 
of, it should be understood by those skilled in the art that the foregoing and various other changes, omissions, and 
additions in the form and detail thereof may be made therein without departing from the spirit and scope of the present 
invention. 

10 

Claims 

1. A picture information converting apparatus for generating an output picture signal with a different scanning line 
structure from an input picture signal, comprising: 

first picture data selecting means tor selecting adjacent pixels with a predetermined relation of positions to a 
plurality ot considered points with a different relation of positions to scanning lines of the input picture signal: 
spatial class detecting means for detecting a pattern of a level distribution from picture data selected by said 
first picture data selecting means and determining spacial class values that represent spatial classes of the 
20 considered points corresponding to the delected pattern: 

second picture data selecting means for selecting the considered points and adjacent pixels with the prede- 
termined relation of positions to the considered points from the input picture signal: 

calculating process means for performing a calculating process for predicting and generating pixels at positions 
with a predetermined relation of positions to the considered points corresponding to the picture data obtained 
2S by said second picture data selecting means: 

storing means for storing predetermined predictive coefficient data used in the calculating process of said 
calculating process means: and 

class value converting means for performing a class value converting process for a first class value with a 
relation of positions to the considered points and the input picture signal and generating a second class value 
30 corresponding to the predictive coefficient data. 

2. A picture information converting apparatus for generating an output picture signal with a different scanning line 
structure from an input picture signal, comprising: 

35 first picture data selecting means for selecting adjacent pixels with a predetermined relation of positions to a 

plurality of considered points with a different relation of positions to scanning lines of the input picture signal: 
spatial class detecting means for detecting a pattern of a level distribution from picture data selected by. said 
first picture data selecting means and determining spacial class values that represent spatial classes of the 
considered points corresponding to the detected pattern: 

40 second picture data selecting means for selecting adjacent pixels with the predetermined relation of positions 

to the considered points from a plurality of frames of the input picture signal: 

motion class detecting means for calculating the sum of the absolute values of frame differences with the 
picture data selected by said second picture data selecting means and determining motion class values cor- 
responding to the calculated result, the motion class values representing motions; 
45 class combining means for combining the spatial class values and the motion class values so as to generate 

a first class value: 

third picture data selecting means for' selecting the considered points and adjacent pixels with the predeter- 
mined i elation of positions to ihe considered points fiom the input picture signal. 

calculating process means for perioiming a calculating process for predicting and generating pixels at positions 
50 with a predetermined relation of positions to the considered points corresponding to the picture data obtained 

by said third picture data selecting means: 

storing means for storing predetermined predictive coefficient data used in the calculating process of said 
calculating process means: and 

class value converting means for performing a class value converting process for the first class value with a 
55 relation of positions to the considered points and the input picture signal and generating a second class value 

corresponding to the predictive coefficient data. 

3. The picture information converting apparatus as set forth in claim 2. 
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wherein said class value converting means performs the class value converting process with reference to a 
class value conversion table generated by a learning process for a particular picture signal in the same signal 
format as the output picture signal. 

4. The picture information converting apparatus as set forth in claim 3, 

wherein the class value conversion table is a data table for calculating temporary predictive coefficients cor- 
responding to the first class value so that the difference of calculated values of a linear combination of pixel 
values of a predetermined picture signal in the same signal format as the output picture signal and picture 
data selected by said third picture data selecting means becomes minimum, calculating distances between 
the temporary predictive coefficients, and when a calculated distance is equal to or less than a predetermined 
threshold value, integrating classes represented by the first class value corresponding to the temporary pre- 
dictive coefficients, and 

wherein the predictive coefficient data is included in the temporary predictive coefficients and corresponds to 
the second class value. 

5. The picture information converting apparatus as set forth in claim 4, 

wherein the predetermined threshold value is set corresponding to the storage capacity of said storing means. 

6. The picture information converting apparatus as set forth in claim 4, 

wherein the predetermined threshold value is set corresponding to the relation of positions between the 
considered points and the scanning lines of the input picture signal. 

7. The picture information converting apparatus as set forth in claim 2 ; 

wherein the input picture signal is an interlace picture signal with 525 scanning lines, and 
wherein the output picture signal is a progressive picture signal with 525 scanning lines. jf . 



wherein the input picture signal is an interlace picture signal with 525 scanning lines, anc|8f^ 
wherein the output picture signal is a progressive picture signal with 1050 scanning lines. 

9. A picture information converting method for generating an output picture signal with a different scanning line struc- 
ture from an input picture signal, comprising the steps of: 

(a) selecting adjacent pixels with a predetermined relation of positions to a plurality of considered points with 
a different relation of positions to scanning lines of the input picture signal: 

(b) detecting a pattern of a level distribution from picture data selected at step (a) and determining spacial 
class values that represent spatial classes of the considered points corresponding to the detected pattern: 

(c) selecting the considered points and adjacent pixels with the predetermined relation of positions to the 
considered points from the input picture signal; 

(d) performing a calculating process for predicting and generating pixels at positions with a predetermined 
relation of positions to the considered points corresponding to the picture data obtained at step (c): 

(e) storing predetermined predictive coefficient data used in the calculating process of step (d); and 

(f ) performing a class value converting process for a first class value with a relation of positions to the consid- 
ered points and the input picture signal and generating a second class value corresponding to the predictive 
coefficient data. 

10. A picture information converting method for generating an output picture signal with a different scanning line struc- 
ture from an input picture signal, comprising the steps of: 

(a) selecting adjacent pixels with a predetermined relation of positions to a plurality of considered points with 
a different relation of positions to scanning lines of the input picture signal: 

(b) detecting a pattern of a level distribution from picture data selected at step (a) and determining spacial 
class values that represent spatial classes of the considered points corresponding to the detected pattern: 

(c) selecting adjacent pixels with the predetermined relation of positions to the considered points from a plurality 
of frames of the inpui picture signal: 



8. The picture information converting apparatus as set forth in claim 2, 
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Id) calculating the sum of the absolute values ol frame differences with the picture data selected at step (c) 
and de.ermmmg motion class values corresponding to the calculated result, the mot.on class values repre- 

(eTcom^ngThe spatial class values and the motion class values so as to generate a first class value: 
5 (f) selecting the cons,dered points and adjacent pixels with the predetermined relation of pos.t.ons to the con- 

sidered points from the input picture signal: 

(q) performing a calculating process for predicting and generating pixels at positions w,th a predeterm.ned 
relation of positions to the considered points corresponding to the picture data obtained at step (f): 
(h) storing predetermined predictive coeflicient data used .n the calculating process of step (g): and 
i) performing a class value converting process for the first class value with a relation of pos.t.ons to the con- 
sidered points and the input picture s.gnal and generating a second class value correspond.ng to the predictive 
coefficient data. 

11 The picture information converting method as set forth in claim 10, 

wherein step (i) is performed as the class value converting process with reference to a class value conversion 
table generated by a learning process lor a pamcular picture signal in the same signal format as the output p.cture 
signal. 

12. The picture information converting method as set fonh in claim 11, 

wherein the class value conversion table is a data table for calculating temporary predictive coefficients cor- 
responding to the first class value so that the d.fierence of calculated values of a linear combination of pixel 
values of a predetermined picture signal in the same signal format as the output picture s.gnal and picture 
data selected at step (f) becomes minimum, calculating distances between the temporary pred.ct.ve coeffi- 
cients and when a calculated distance is equal to or less than a predetermined threshold value, integrating 
classes represented by the first class value corresponding to the temporary pred.ctive coefficients, and 
wherein the predictive coefficient data is included in the temporary predict.ve coeffic.ents and corresponds to 
the second class value 

30 13. The picture information converting method as set forth in claim 10. 

wherein the input picture signal is an interlace picture signal with 525 scanning lines, and 
wherein the output picture signal is a progressive picture signal with 525 scanning lines. 

35 14. The picture information converting method as set forth in claim 10, 

wherein the input picture s.gnal is an interlace picture signal with 525 scanning lines, and 
wherein the output picture signal is a progressive picture signal with 1050 scanning l.nes. 

40 15. A television receiver for generating an output picture signal with a different scanning line structure from an input 
picture signal, comprising: 

first p,cture data selecting means for selecting adjacent pixels with a predetermined relation of positions to a 
plurality of cons.dered points with a different relation of positions to scanning lines of the input picture signal 
spatial class detecting means for detecting a pattern of a level d.stribut.on from p.cture data selected by said 
first picture data selecting means and determining spacial class values that represent spatial classes of the 
considered ooints corresponding to the detected pattern. 

second pictuie data selecting means for selecting the considered points and adjacent pixels with the piede- 
teimined i elation of positions to the considered points from the input picture signal: 
so calculating process means lor performing a calculating process for predicting and generating pixels at positions 

with a predetermined relation of positions to the considered points corresponding to the picture data obtained 
bv said seconc picture data selecting means: 

storing means for storing predetermined predictive cocff.cicnt data used in the calculating process of said 
calculating process means: and 

class value converting means for performing a class value converting process for a first class value with a 
relation of positions to the considered points and the input picture signal and generating a second class value 
corresponding to the predictive coeflicient data 
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16. A television receiver for generating an output picture signal with a different scanning line structure from an input 
picture signal comprising: 

first picture data selecting means for selecting adjacent pixels with a predetermined relation of positions to a 
plurality of considered points with a different relation of positions to scanning lines of the input picture signal: 
spatial class detecting means for detecting a pattern of a level distribution from picture data selected by said 
first picture data selecting means and determining spacial class values that represent spatial classes of the 
considered points corresponding to the detected pattern: 

second picture data selecting means for selecting adjacent pixels with the predetermined relation of positions 
to the considered points from a plurality of frames of the input picture signal: 

motion class detecting means for calculating the sum of the absolute values of frame differences with the 
picture data selected by said second picture data selecting means and determining motion class values cor- 
responding to the calculated result, the motion class values representing motions: 

class combining means for combining the spatial class values and the motion class values so as to generate 
a first class value: 

third picture data selecting means for selecting the considered points and adjacent pixels with the predeter- 
mined relation ol positions to the considered points from the input picture signal; 

calculating process means (or performing a calculating process for predicting and generating pixels at positions 
with a predetermined relation of positions to the considered points corresponding to the picture data obtained 
by said third picture data selecting means. 

storing means for storing predetermined predictive coefficient data used in the calculating process of said 
calculating process means: and 

class value converting means for performing a class value converting process for the first class value with a 
relation of positions to the considered points and the input picture signal and generating a second class value 
corresponding to the predictive coefficient data. 

17. The television receiver as set forth in claim 16, 

wherein said class value converting means performs the class value converting process with reference to a 
class value conversion table generated by a learning process for a particular picture signal in the same signal 
format as the output picture signal 

18. The television receiver as set forth in claim 17. 

wherein the class value conversion table is a data table for calculating temporary predictive coefficients cor- 
responding to the first class value so that the difference of calculated values of a linear combination of pixel 
values of a predetermined picture signal in the same signal format as the output picture signal and picture 
data selected by said third picture data selecting means becomes minimum, calculating distances between 
the temporary predictive coefficients, and when a calculated distance is equal to or less than a predetermined 
threshold value, integrating classes represented by the first class value corresponding to the temporary pre- 
dictive coefficients, and 

wherein the predictive coefficient data is included in the temporary predictive coefficients and corresponds to 
the second class value. 

19. The television receiver as set forth in claim 16, 

wherein the input picture signal is an interlace picture signal with 525 scanning lines, and 
wherein the output picture signal is a progressive picture signal with 525 scanning lines. 

20. The television leceivei as set forth in claim 17. 

wherein the input picture signal is an interlace picture signal with 525 scanning lines, and 
wherein the output picture signal is a progressive picture signal with 1050 scanning lines. 
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(57) A picture information converting apparatus 
generates an output picture signal with a different scan- 
ning line structure from an input picture signal. The ap- 
paratus comprises a first picture signal is disclosed, that 
comprises a first picture data selecting means for se- 
lecting adjacent pixels with a predetermined relation of 
positions to a plurality of considered points with a differ- 
ent relation of positions to scanning lines of the input 
picture signal, a spatial class detecting means for de- 
tecting a pattern of a level distribution from picture data 
selected by said first picture data selecting means and 
determining spacial class values that represent spatial 
classes of the consideied points corresponding to the 
detected pattern, a second picture data selecting means 
for selecting the considered points and adjacent pixels 
with the predetermined relation of positions to the con- 
sidered points from the input picture signal, a calculating 
process means for performing a calculating process-for 
predicting and generating pixels at positions with a pre- 
determined relation of positions to the considered points 
corresponding to the picture data obtained by said sec- 
ond picture data selecting means, a storing means fGr 
storing predetermined predictive coefficient data used 
in the calculating process of said calculating process 
means, and a class value converting means for perform- 



ing a class value converting process for a first class val- 
ue with a relation of positions to the considered points 
and the input picture signal and generating a second 
class value corresponding to the predictive coefficient 
data. 
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